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Abstract 

Since Massive Open Online Courses (MOOCs) are accessible by anyone in the world at no cost, 
they have large enrollments that are conducive to educational research. This study examines 
students in the Coursera MOOC, Introductory Human Physiology. Of the 33,378 students who 
accessed the course, around 15,000 students responded to items on the pre-course survey about 
their age, educational background, proficiency in English, and plans for participating in the 
course. We categorized students who completed the pre-course survey into groups based on the 
number of exams completed and corresponding course achievement level. We used Chi-square 
goodness of fit tests to analyze the distribution of students’ responses on the pre-course survey 
and associated achievement level. Of the students who responded to the pre-course survey and 
passed with distinction, a larger percentage self-identified as fluent in English while a smaller 
percentage self-identified as beginners. Students with graduate degrees were more likely to pass 
the course or pass with distinction than students with only some college experience or a 
bachelor’s degree. Students who completed either some or all exams were more likely to self- 
report intention to complete all course activities than students who did not take any exams. A 
greater proportion of students who passed the course or passed with distinction posted two or 
more times on the course discussion forum. Understanding MOOC students and the 
characteristics that lead to their success will enable modification to courses for increased student 
achievement and may also inform teaching in the traditional classroom. 
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Introduction 

Massive Open Online Courses (MOOCs) are offered over the internet and are open to anyone in 
the world at no cost. There are several major MOOC providers such as edX, Udacity, and Coursera 
(Pappano, 2012). One of the main goals of MOOC providers is to provide free educational 
opportunities to people around the world. 

One MOOC provider, Coursera, has partnered with more than too colleges and universities from 
all over the world to offer more than 600 courses in varying topics (Coursera, 2014). More than 5 
million students have taken Coursera courses. Currently, students do not earn credit from the 
institution offering the course. However, students successfully completing the course receive a 
Statement of Accomplishment. In some Coursera courses, students can pay a fee to receive a 
Verified Certificate through the Signature Track. The identity of students on the Signature track is 
verified using their webcam and the pattern of their typing (Coursera, 2014). 

Students in online university courses have higher attrition rates compared to face-to-face courses 
(Carr, 2000; Xu, 2014; Xu, 2011). Because there is no cost to enroll in a MOOC and registration is 
a simple process, completion rates for MOOCs are low compared to traditional online and face-to- 
face courses. Many MOOC students do not plan to complete all components of the course when 
they enroll. There is no penalty for discontinuing a MOOC, particularly since the courses are not 
for credit towards a degree. However, a minority of students complete all of the required 
components of MOOCs and score well on the course assessments. One advantage of MOOCs over 
traditional university courses is that MOOCs enable students to choose how they want to 
participate in the course by allowing them to take as many components of the course as they 
choose. 

Studies have been published examining the intent of students and how it compares with their 
completion of a MOOC. Roller (2013) showed that in one Coursera course, 74% of students who 
enrolled in the Signature Track, which includes paying a small fee, completed the course 
compared to a 9% completion rate for students not enrolled in the Signature Track. A similar 
effect was seen in 2008 with two versions of an online course that was offered by the University of 
Manitoba to anyone in the world for credit or at no cost. The students taking the course for credit 
were much more likely to complete the course than those taking the identical open version (Fini, 
2009). 

Research Question 

Research has begun to examine the characteristics of students who successfully complete MOOCs 
(Liyanagunawardena, 2013). For example, several studies have shown that a larger proportion of 
students who earned a course certificate also posted on the discussion forum (Breslow, 2013; 
Gillani, 2014; Ho, 2014; Kizilcec, 2013). Additionally, studies have shown that in some courses, 
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students who earn certificates tend to be older, more educated, and have previous experience in 
the field of study (Breslow, 2013; Ho, 2014). 

The aim of our current study is to describe the student characteristics involved with the 
completion and earned level of achievement in the Coursera course, Introductory Human 
Physiology offered by Duke University. To accomplish this, we categorized students who 
completed the pre-course survey into groups based on the number of exams they completed and 
their corresponding course achievement level. This allowed us to examine demographic data of 
the students divided into groups based on both motivation and achievement. As a result of this 
unique method of dividing the students, we were able to gain insights about our student 
population that is unprecedented for studies of MOOCs thus far. 


Methods 

This study examines the first session of the Coursera course, Introductory Human Physiology, 
which began in February 2013. This study was approved for exemption by the Duke University 
School of Medicine Institutional Review Board. 


Course Details 

Introductory Human Physiology is a 12 week Coursera course based on a Duke University 
graduate course originally designed to teach physiology to biomedical engineering students. 
Topics include the physiology of the nervous system, skeletal muscle, cardiovascular system, 
respiratory system, endocrine system, reproductive system, gastrointestinal system, and the 
urinary system. 

Each week, Coursera Introductory Human Physiology students were provided 2 to 8 video 
lectures that varied in length from 7 to 40 minutes. The majority of videos contained 1 to 3 in¬ 
video questions that served to summarize and/or highlight video content. Lecture notes and 
PowerPoint slides were also provided to the students. Multiple-choice problem sets were provided 
for most organ systems through the Coursera platform. These were optional and were not graded. 
Once the students submitted their responses to the problem set, they immediately received 
feedback about whether their answers were correct. Students could continue to attempt the 
problem sets until they answered all items correctly. 

The course grade was based on average scores on three multiple-choice question exams. Each 
exam was administered in three parts of 15-20 questions each. Students were given 30 minutes to 
answer each part, and each part could be taken only once. Each exam was available to students for 
1-2 weeks. 
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Students with an exam average of 70-84% passed the course and received a Statement of 
Accomplishment. Students with an 85% or higher average passed with distinction and earned a 
Distinction Statement of Accomplishment. Students had the option of paying a small fee to join 
the Signature Track which enables students to earn a Verified Certificate. 

Students had access to a discussion forum on the Coursera website that allowed them to post 
questions or comments about the material and the course. The discussion forum consisted of 
several sub-forums specific to lectures, technical feedback, problem sets, etc. This architecture 
allowed for student comments and questions to be sorted by a specific topic. Course instructors 
and staff at Duke answered students’ questions. 

Via announcements on the course webpage and email, students were notified about pre-course 
and post-course surveys administered by Duke University using Qualtrics, a web-based survey 
system (Qualtrics, LLC). Students were informed that the survey participation was voluntary and 
that responses may be used for research purposes. Only data from the pre-course survey was 
analyzed due to a small number of responses to the post-course survey (about 1,100 respondents). 

Data Processing 

Data for the first session of Introductory Human Physiology were obtained from Coursera as a set 
of individual tables in either SQL or text format. Data from pre- and post-course surveys were 
obtained from the Qualtrics instance hosted by Duke University. 

All source datasets were converted into SAS datasets using SAS 9.3®. The source data were 
merged using unique student identification numbers. We constructed three variables into the 
dataset: total number of course forum posts per student, an “all tests” indicator variable flagged 
those students who completed every test offered in the course, and a “some tests” indicator 
variable flagged those students who completed at least one test, but did not take every test 
offered. 

The dataset was then de-identified by removing student name, email address, and IP address 
variables. Additionally, the Coursera-issued unique student identification number was replaced 
with a random student identification number created at Duke University. 

The students who completed the pre-course survey were categorized into five groups: 

1. students who did not complete any exams in the course, 

2. students who completed some exams but not all exams, 

3. students who completed all three exams but did not pass the course, 

4. students who passed the course but did not earn distinction, and 

5. students who passed the course with distinction. 
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Data Analysis 

The distribution of student responses to various pre-course survey items, based upon their exam 
completion and achievement level groups, was analyzed. Since the responses on the survey were 
all categorical, all variables were treated as categorical. Using the chi-square goodness of fit test, 
the observed distribution of responses for a group was compared to the expected distribution of 
responses for all students who answered survey items. Significance was set at < 0.05 level. Only 
those observations with a p value < 0.05 are reported here. Student gender and ethnicity data 
were not available through the pre-course survey. 


Results 


Descriptive Analysis 

Table 1 illustrates the exam completion and achievement level profile for students who accessed 
the Introductory Human Physiology course. The majority of students (84%) who accessed the 
course did not complete any of the exams. 11% of students completed at least one part of an exam 
but did not complete all of the exams. A small percentage (about 2%) of students who accessed 
the course completed all of the exams but did not pass the course. Another 2% of students passed 
the course without distinction, while only 1% of students passed the course with distinction. 
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Table 1 


Statistics from the First Session of Introductory Human Physiology 


Number of students who 
accessed the course 
Number of students who did 
not complete any exams 
Number of students who 
completed some exams but not 
all 

Number of students who 
completed all exams but did 
not pass 

Number of students who 
passed the course but did not 
earn distinction 
Number of students who 
passed the course with 
distinction 

Number of discussion forum 
posts 

Number of students who 
posted on the forum 


33,738 

28,304 (84%)* 
3,778 (n96)* 

620 (1.8%)* 

698 (2.0%)* 

338 (1.0%)* 

5,431 

2,185 (6.5%)* 


~as a percentage of the number of students who accessed the course 


Age 

15,046 students answered the pre-course survey question about age. Of these, 29.5% answered 
that they were between 18-25 years of age, 30.3% answered 26-34 years of age, 17.4% answered 
35-44 years of age, 12.6% answered 45-54 years of age, 7.6% answered 55-64 years of age, and 
2.7% answered 65 years old or older. Students younger than 18 years old were not included. When 
students were divided into groups based on the number of exams they completed and based on 
their achievement in the course, chi-square goodness of fit analyses indicated there was no 
significant difference (p < .05) in the proportion of age groups across all achievement levels. 

English as a 1 st language 

In the pre-course survey, students were asked, “Is English your 1 st language?” Among the 15,310 
students who answered the question, the majority (56.9%) answered “no”. A Chi-square 
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goodness of fit test indicated that a significantly lower proportion of students who reported as 
non-native English speakers completed all of the exams but did not pass (47.0%) compared to all 
students who answered the question and reported as non-native English speakers (56.9%), x 2 (1, n 
= 328) = 4.1, p < .05. 

Level of English Proficiency 

Students who reported they were non-native English speakers were asked, “Please indicate your 
level of proficiency with the English language.” Of the 6,537 students who answered the question, 
43.1% self-identified as fluent, 33.7% as proficient, 20.7% as intermediate, and 2.5% as beginners 
(Fig. 1). Less than one quarter of students who answered that English was not their first language 
self-identified as intermediate or beginners in English. When the students were divided into 
groups based on how many exams they completed and their level of achievement, a chi-square 
goodness of fit test indicated there was a significantly higher proportion of students who self- 
identified as fluent and earned distinction (49.5%) compared to all students who answered the 
question (43.1%), x 2 (1, n = 111) = 4.1, p < .05 (Fig. 1). Among students who completed all of the 
exams but did not pass the course, a statistically significant lower proportion self-identified as 
fluent (32.9%) compared to all students (43.1%), x 2 (1, n = 173) = 4.1, p < .05. Yet, a statistically 
significant higher proportion self-identified as intermediate (30.6%) compared to all students 
(20.7%) who answered the question (x 2 (1, n = 173) = 6.0, p < .05, Fig. 1). 


This work is licensed under a Creative Commons Attribution 4.0 International License. 


52 



Coursera's Introductory Human Physiology Course: Factors that Characterize Successful Completion of a MOOC 

Engle, Mankoff, and Carbrey 


100 % 

90% 

80% 

70% 

60% 

50% 

40% 

30% 

20 % 

10 % 

0 % 


2.6 

20.1 

33.1 


44.2 


2.3 

23.2 

36.7 

37.9 


2.9 


1.4 



18.2 

30.6 

+ 

38.8 

33.5 



32.9 

A 

41.6 


Did not take Took some Took all 
any exams, exams, n=832 exams but 
n=5212 did not pass, 

n=173 


Took all 
exams and 
passed, 
n=209 


0.9 * 

2.5 * 

18.9 

20.7 + 

30.6 



33.7 

49.5 X 

43.1 X 


A 


Took all 
exams and 
earned 
distinction, 
n=lll 


All students 
who 

answered the 
question, 
n=6537 


Beginner 

Intermediate 

Proficient 

Fluent 


Figure l. Students who answered that English was not their first language were asked to choose 
their level of proficiency with the English language. The responding students were divided into 
five different groups based on the number of exams they completed and whether or not they 
passed the course or passed with distinction. The bars show the percentage of students in each 
proficiency category based on the students’ answers on the pre-course survey. The bar on the 
right shows the percentage of students in each category for all of the students who answered the 
question on the pre-course survey. The symbols to the right of each bar (*, +, x, •*) denote 
statistically significant differences between groups as assessed with the chi-square goodness of fit 
test with the p value <0.05. Groups marked with the same symbol denote two groups with 
statistically significant differences. 


Education 

Students who completed the pre-course survey were asked, “What is the highest level of education 
you have completed?” Of the 14,821 students who answered the question, 9.7% had completed 
high school or the equivalent, 20.3% had completed some college, 36.2% had completed a 
bachelor’s degree, 23.4% had completed a master’s degree, 5% had completed a doctoral degree, 
and 5.3% had completed a professional degree (Fig. 2). More than half of the students who 
answered the pre-course survey question had bachelor’s or master’s degrees. When the students 
were divided based on the number of exams they completed and whether or not they passed the 
course, there were a number of statistically significant differences in the education level of the 
groups (Fig. 2). Chi-square goodness of fit tests indicated there was a significantly smaller 
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proportion of students with some college but not a bachelor’s degree who passed the course 
(10.7%) and passed the course with distinction (9.8%) compared to all students who answered the 
question (19.8%) x 2 (l, n = 411) = 5.1, p < .05 and x 2 (1, n = 214) = 7.6, p < .05. In contrast, chi- 
square goodness of fit tests indicated there was a significantly larger proportion of students with a 
doctoral degree who passed the course without distinction (10.2%) or who passed the course with 
distinction (15.4%) compared to all students who answered the question (5.0%) x 2 (1, n = 411) = 
5.3, p < .05 and x 2 (1, n = 214) = 21.1, p < .05, Fig. 2). Chi-square goodness of fit tests indicated 
students with a professional degree were statistically overrepresented in the group of students 
who completed all exams but did not pass (10.7%) and in the students who passed with 
distinction (10.3%) compared to all of the students who completed the pre-course survey (5.2%) 
X 2 (1, n = 328) = 7.6, p < .05 and x 2 (1, n = 214) = 5 - 3 , P < - 05 , Fig. 2). 
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AX 


Professional Degree 
Doctoral Degree 
■ Master's Degree 
Bachelor's Degree 
Some College 

Secondary/High School/ U.S. GED 
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Figure 2. Students who submitted information on the pre-course survey about their highest 
completed level of education were divided into five different groups. Each bar is divided based on 
the percentage of students submitting each answer on the pre-course survey. The symbols to the 
right of the bars denote statistically significant differences between groups as assessed with the 
chi-square goodness of fit test with the p value <0.05. Groups marked with the same symbol 
denote two groups with statistically significant differences. 
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Academic Background 

Within the pre-course survey, students were also asked about their academic background. 15.1% 
of students responded that humanities best described their academic background while 17.8% 
answered natural sciences, 13.9% answered social sciences, 30.6% answered health sciences, 
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11.6% answered professional, and 11.0% answered technical (Fig. 3). Among the students who 
took some exams but not all, a chi-square goodness of fit test indicated the students with a health 
science background (42.7%) were a significantly higher proportion compared to their proportion 
among all students who answered the question (30.6%) x 2 (1, n = 1325) = 6.7, p < .05 (Fig. 3). 
Another chi-square goodness of fit test indicated that students with a social sciences background 
(7.0%) were a significantly smaller proportion of students who completed all exams but did not 
pass (13.9%) x 2 (1, n = 243) = 4.1, p < .05 (Fig. 3). Among the students who earned distinction in 
the course, students with a humanities background were underrepresented (7.5% versus 15.1%, x 2 
(1, n = 174) = 3.8, p = .05) and students with a natural sciences background were overrepresented 
(32.8% versus 17.8%, x 2 (1, n = 174) = 15.2, p < .05 Fig. 3). 
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n=174 question, n=12419 

Figure 3. Students who answered the pre-course survey question, “Which of the following 
describes your academic background?” were divided into five different groups based on the 
number of exams they completed and whether or not they passed the course or passed with 
distinction. The bars show the percentage of students in each group that chose each answer on the 
pre-course survey. The symbols to the right of the bars denote statistically significant differences 
between groups as assessed with the chi-square goodness of fit test with the p value <0.05. 
Groups marked with the same symbol denote two groups with statistically significant differences. 
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Previous Experience 

The pre-course survey included a question about the students’ previous experience with the 
course’s subject area. Of the 15,234 students who answered the question, 23.5% responded that 
they were mostly new to the subject, 25.6% liked to explore the subject on their own, 35.5% had 
completed some coursework in physiology or had some work experience, and 15.4% responded 
that they had a degree in physiology or significant work experience in the field (Fig. 4). Students 
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who had completed some physiology coursework or who had some work experience were 
overrepresented in the group of students who passed the course with distinction (48.4% versus 
35 - 5 %, X 2 (h n = 213) = 6.3, p < .05, Fig. 4). Students with significant work experience or a degree 
in physiology were overrepresented in the group of students who passed the course without 
distinction (22.8%) compared to all students (15.4%), x 2 (1, n = 328) = 5.0, p < .05, Fig. 4). 
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Figure 4. Students who answered the pre-course survey question, “What best describes your 
previous experience in the course’s subject area?” were divided into five different groups. The 
bars show the percentage of students in each group that chose each answer on the pre-course 
survey. The symbols to the right of the bars denote statistically significant differences between 
groups as assessed with the chi-square goodness of fit test with the p value <0.05. Groups marked 
with the same symbol denote two groups with statistically significant differences. 
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Student Intentions 

Much has been written in the press about the small percentage of students who complete MOOCs 
(Haynie, 2014; Morrison, 2014; Waldrop, 2013). Our pre-course survey included questions about 
the students’ intentions for the course. When asked how many of the course activities the students 
planned to complete, 1.6% answered none, 18.2% answered few, 35.4% answered most, and 
44.8% answered all (Fig. 5). 

When the responses to this question about intention to complete course activities was 
disaggregated according to achievement level, the mean proportion of students who intended to 
complete all activities was significantly higher (59.1%) among students who took at least one 
exam than all students who answered the question (44.8%), x 2 (1, n = 667) = 7.9, p < .05 (Fig. 5). 
Moreover, the mean proportion of students who took at least one exam and who responded they 

This work is licensed under a Creative Commons Attribution 4.0 International License. 


56 




Coursera's Introductory Human Physiology Course: Factors that Characterize Successful Completion of a MOOC 

Engle, Mankoff, and Carbrey 


would complete few activities was significantly lower (8.4%) than all students who answered the 
question (18.2%), x 2 (1, n = 667) = 6.8, p < .05 (Fig. 5). Students who took at least one exam were 
more likely to have responded that they would complete the course and less likely to have 
responded that they would complete few activities. 
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Figure 5. Students were asked the pre-course survey question, “How much of the course activities 
do you plan to complete?” Each bar is divided based on the percentage of students submitting 
each answer on the pre-course survey. The symbols to the right of the bars denote statistically 
significant differences between groups as assessed with the chi-square goodness of fit test with 
the p value <0.05. Groups marked with the same symbol denote two groups with statistically 
significant differences. 


Students were also asked how many hours they anticipated spending on the course each week. Of 
the 15,226 students who answered the question, 20.6% answered 1-3 hours, 47.7% answered 4-6 
hours, 22.4% answered 7-9 hours, 6.5% answered 10-12 hours, and 2.7% answered 13 or more 
hours (Fig. 6). Students who expected to spend 1-3 hours on the course and completed all exams 
but did not pass (12.6%), passed the course (10.2%), and passed with distinction (7.0%), were a 
significantly smaller percentage compared to all students who answered the question (20.6%), x 2 
(1, n = 326) = 3 - 9 , P < -05 and x 2 (1, n = 413) = 7 -2, p < .05 and x 2 (l, n = 215) = 11.8, p < .05, (Fig. 
6). A significantly larger percentage of students who completed all the exams but did not pass 
answered 7-9 hours (31.6%) compared to all students who answered the question (22.4%), x 2 (1, n 
= 326) = 5-8, p < .05, (Fig. 6). 
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Figure 6. Students who answered the pre-course survey question, “How many hours per week will 
you be spending on this course?” were divided into five different groups based on the number of 
exams they completed and whether or not they passed the course or passed with distinction. The 
bars show the percentage of students in each group that chose each answer on the pre-course 
survey. The symbols to the right of the bars denote statistically significant differences between 
groups as assessed with the chi-square goodness of fit test with the p value <0.05. Groups marked 
with the same symbol denote two groups with statistically significant differences. 


Forum Activity 

The number of times a student posted on the course discussion forum was also examined. 6.5% of 
the students who accessed the course posted on the discussion forum (Table 1). Since the vast 
majority of students who did not take any exams did not post on the discussion forum, that group 
was not included in our analysis. Of the 5,430 students who completed at least one exam, 80.2% 
did not post on the forum, 10.0% posted once, 8.6% posted 2-10 times, and 1.1% posted more 
than 10 times (Fig. 7). 

When students were disaggregated into groups based on the number of exams they completed 
and whether or not they passed the course, the majority of all four groups did not post on the 
discussion forum (Fig. 7). Of the students who passed the course without distinction, a greater 
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proportion posted on the forum 2-10 times (15.7%) or more than 10 times (2.3%) compared to all 
students (8.6% and 1.1%, respectively), x 2 (l, n = 214) = 6.0, p < .05 and x 2 (l, n = 214) = 4.0, p < 
.05, (Fig. 7). The proportion was even higher for students who passed with distinction as 19.5% 
posted 2-10 times and 6.2% posted more than 10 times (x 2 (1, n = 128) = 14.8, p < .05 and x 2 (1, n 
= 128) = 25.3, p < .05 ,Fig. 7). Among the students who completed all exams but did not pass, 
15-5% posted 2-10 times compared to 8.6% who completed at least one exam (x 2 (1, n = 186) = 6.0 
p < .05, Fig. 7). 
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Figure 7. Students who completed at least one exam were divided into five different groups based 
on the number of exams they completed and whether or not they passed the course or passed with 
distinction. The bars show the percentage of students in each category based on the number of 
times they posted on the forum. The symbols to the right of the bars denote statistically 
significant differences between groups as assessed with the chi-square goodness of fit test with 
the p value <0.05. Groups marked with the same symbol denote two groups with statistically 
significant differences. 
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Discussion 

Of the 33,738 students who accessed the 1 st session of Introductory Human Physiology, 16% 
completed at least a part of an exam and 3% passed the course. This pass rate is lower than the 
roughly 5% of students who pass Coursera courses in general (Roller, 2013) and the median pass 
rate of 6.5% for MOOCs in general (Jordan, 2014). Since our course is based on a graduate course, 
a lower pass rate may be expected. 

Our study was focused primarily on student responses to the pre-course survey. Since most 
survey items had around 15,000 responses, we captured data from about 45% of our student 
population. We divided the students into five groups based on the number of exams completed 
and course achievement level. Because of this division, we were able to gather data that is 
unprecedented in the MOOC literature. Several studies have compared students who successfully 
completed a MOOC to those who accessed varying amounts of the course material (Ho, 2014; 
Kizilcec, 2013). However, we gained additional information by examining the characteristics of 
students who completed all of the exams but did not pass the course and those who were able to 
pass with distinction. 

Age 

Several studies have shown that older students score higher on assessments examining self- 
directed learning readiness which may be important for MOOC retention and achievement 
(Alspach, 1991; Dixon, 1992; Eyer, 1993; Frisby, 1991; Morris, 1995; Reio, 2005). In addition, a 
study of students in an online undergraduate business course showed that age correlated 
positively with the final grade in the course (Wojciechowski, 2005). In our study, there was no 
significant difference with respect to age in the composition of groups of students separated based 
on the amount of the course they completed and their achievement level. This has been reported 
in the literature for other MOOCs (Breslow, 2013; Root Kustritz, 2014). It is possible that since so 
few students intend to complete MOOCs and there is no penalty for withdrawing, the effects of 
age and self-directed learning readiness are not evident. 

In a study of the first 17 courses available on the edX platform, certificate earners had a median 
age that was two years older than the median age for the courses (Ho, 2014). Since our pre-course 
survey asked the students to select their age range, we cannot calculate median age. However, the 
median age range of students who did not pass the course and those students who passed without 
distinction was 26-34 years old. The median age range of students who passed with distinction 
was 35-44 years old. 

English Proficiency 

Of the students who took all of the exams but did not pass, non-native English speakers who were 
fluent were a smaller percentage and intermediate students were a larger percentage compared to 
all students who answered the question. Of the students who earned distinction, fluent students 
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were a larger percentage and beginner students were a smaller percentage compared to all non¬ 
native English speakers that answered the question. Although our results suggest that a student’s 
proficiency in English does influence their likelihood of earning distinction, the proficiency of the 
group of students who passed the course without distinction was very similar to the proficiency of 
all students who answered the question. Perhaps translations of the course or increased time for 
exams can increase achievement among beginner and intermediate English speakers. Following 
the completion of the first session of Introductory Human Physiology additional translated 
resources have been made available to students. 

Education 

Students with doctoral degrees were a greater proportion of the students who passed the course 
or passed the course with distinction. This is not surprising considering the course is based on a 
Duke University graduate course, albeit an introductory one. This effect of educational 
background on student achievement has also been observed for other MOOCs (Breslow, 2013; 
Ho, 2014). In addition, several studies have shown that students with advanced degrees score 
higher on assessments examining self-directed learning readiness which may be important for 
MOOC completion and achievement (Alspach, 1991; Dixon, 1992; Durr, 1992; Martin, 1992). 

Academic Background 

Among students who earned distinction, students with a natural sciences background were 
overrepresented and those with a humanities background were underrepresented. These results 
suggest the academic background of a student influences the achievement level obtained in our 
course. This fairly subtle effect of experience on student achievement has been observed in 
another MOOC (Breslow, 2013). Despite this effect, a substantial number of students were able to 
successfully complete the course without a natural sciences or health sciences background. 
Providing more basic biology resources for students who need more background information may 
improve performance in our course for certain students. 

Previous Experience 

Not surprisingly, students with at least some experience in physiology were more likely to pass 
the course or pass the course with distinction. A previous study of an undergraduate economics 
course shows that student experience in a specific topic reduced attrition and increased 
performance (Anderson, 1994). In our study, 17% of students who passed the course and 
answered the pre-course survey stated that they were mostly new to the subject, indicating that 
the course was not excessively difficult for beginners. 

A recent study of an introductory physics MOOC suggested that many students learned a similar 
amount no matter what their background with the subject matter (Colvin, 2014). For instance, 
students that showed low ability at the beginning of the course learned the same amount as 
students with high ability at the beginning of the course (Colvin, 2014). Although this was not the 
focus of our study, our results somewhat support their conclusions since students with at least 
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some experience in physiology were more likely to pass the course. Further studies of students 
who take our MOOC multiple times could help us understand the patterns of student behavior 
that lead to successful completion based on previous experience with physiology. This may also 
allow us to counsel students on strategies for eventually completing the course. 

Student Intentions 

Among the students who took at least one exam, a higher percentage answered that they would 
complete all of the course activities and a lower percentage answered that they would complete 
few. Even though 44.8% of students intended to complete all three exams, only 6 % of the students 
who answered the question actually completed them. This suggests that many students are not 
able to accurately predict how much of the course they will complete. 

It would be informative to survey students who intended to complete the course but stopped 
participating, in order to determine what prevented them from completing the course. One 
advantage of MOOCs is that they are cost-free. This provides students with the freedom to decide, 
as well as continually reassess, how much of the course they would like to complete as they 
progress through the course. 

Of the students who took all of the exams, a smaller percentage said that they would spend only 1- 
3 hours on the course each week. This suggests that more students who completed the course 
anticipated that they would need to spend more than 1-3 hours a week on the course. This may be 
due in large part to the fact that Coursera informed the students that the course will require 6-8 
hours per week on the webpage for the course. 

In a study of a subset of students in 3 MOOCs from San Jose State University, student effort was 
the strongest predictor of student success (Firmin et al., 2014). Factors such as student 
demographics and characteristics did not impact whether or not a student was successful in a 
significant way (Firmin et al., 2014). Our study only focuses on the number of hours a student 
intends to spend on the course. Further study into the number of hours needed to be successful 
would be helpful in trying to counsel students in how to be successful in our course. 

Forum Activity 

Of the students who either passed the course or earned distinction, a higher proportion of them 
posted on the discussion forum multiple times than the students who were less successful. 
However, across all groups, the majority of students did not post on the discussion forum. In a 
published analysis of three MOOCs, the students who completed most of the assessments were 
more likely to have participated in the discussion forums (Kizilcec, 2013). In two different studies 
of edX MOOCs, the students who earned a certificate were more likely to have posted on the 
forum (Breslow, 2013; Ho, 2014). In a business strategy MOOC, the students who posted on the 
forum were more likely to have successfully completed the course, although the majority of forum 
participants did not complete the course (Gillani, 2014). The number of posts on the discussion 
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forum may be another way to measure engagement in the course similar to the number of exams 
a student takes. Studies of students participating in distance education suggest that participation 
in discussion forums can play a positive role in student retention and achievement (Baxter, 2012). 
In our course, posting on the forum was not a required portion of the course. Although there were 
statistically significant differences between groups of students, the differences were not drastic 
enough to allow anticipation of a student’s level of achievement based on the number of 
discussion forum posts. 


Conclusions and Future Studies 

With the exception of age, every demographic variable and pre-course survey question had 
statistically significant differences between groups of students. Most of these observations are 
fairly expected. Variables such as English proficiency, educational background, experience in the 
subject of the course, intentions of the student, and the number of forum posts make a student 
more likely to achieve at a certain level in the course. However these differences are not large 
enough to be able to anticipate student achievement based on student characteristics. 

Unfortunately, information about gender and ethnicity were not available for this study. Although 
the gender of the students was an item on the pre-course survey, we were not able to obtain the 
data. The ethnicity or race of the students was not an item on the pre-course survey. Examining 
the effect of these variables on the completion and achievement in our course and in other 
MOOCs requires further study. 

Improving the completion and passing rates of MOOCs will require understanding why some 
students lose motivation to complete the course and why some students have difficulty passing 
the course even though they have adequate motivation. In an attempt to answer these questions, 
we included a series of items on our post-course survey targeted to students who did not complete 
or pass our course. These students indicated on a Likert-type scale (1= no effect, 2= slightly more 
likely, 3= much more likely) whether certain adjustments would have made it more likely that 
they would have successfully completed the course. Aggregate mean results from 456 respondents 
show that reducing the weekly time commitment (X =1.8) and making the course easier ( X = 
1.7) are course adjustments that might have had some effect on completion. Results also show 
that making the credential more valuable (X = 1.4), stating the needed prerequisites clearly (X 
= 1.4), making the course length shorter ( X = 1.3), and making the course more difficult ( X = 
1.1) may or may not have an effect on completion. Altogether, these results suggest that there are 
multiple reasons why more students did not successfully complete our course and that it is a 
complex issue. More specific questions about a student’s motivations throughout the course 
should enable improved course design aimed at increasing achievement among students who lose 
motivation. This could be accomplished through frequent surveying of students about their 
reasons for their level of involvement in the course. 
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Our study, as well as studies from others (Breslow, 2013; Ho, 2014), have shown that student 
characteristics such as proficiency in English, highest level of education, and academic 
background can influence achievement in MOOCs. The impact of modifying courses to improve 
performance among students with certain characteristics should be examined. For example, 
studies could examine how providing additional translated resources in a course effects 
completion and performance. Similarly, studying how providing background material for 
students who may not yet have a bachelor’s degree or experience in the topic affects retention and 
achievement. 

Understanding the factors that lead students who intend to complete a course to leave a course 
may enable modifications that increase retention. Improving retention in online courses through 
modification has been described previously (Chyung 2001). However, many of the modifications 
made in the study involved providing individual attention which is not practical in a MOOC with 
an enrollment of 30,000 students. Due to the large enrollment of MOOCs, however, even small 
changes in retention and achievement will impact a large number of students. 
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